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(57)Abstract: 

PROBLEM TO BE SOLVED: To provide an EPG 
(electronic program guide) which can easily retrieve the 
programs by producing questions to identify the 
programs to be watched by viewers and presenting the 
retrieved programs to the viewers. 
SOLUTION: A receiver 50 rearranges the video, audio 
and programming data from a digital transport packet. A 
contents separator 74 separates the video and audio 
data from the programming information. The separated 
video and audio data are sent to a tuner contained in a 
viewer computing unit 60, and the video data are shown 
on a monitor 62 after a specific channel is selected. 
Then the audio data corresponding to the video data are 
reproduced. A viewer controls the selection of programs 
by means of a keyboard 66 or a remote control handset 
68. The programming information is inputted and cached 
into an EPG data base 72. Thus, the viewer can select 
the programs via an EPG. 
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1. Title of Invention 

7 QUERY-BASED ELECTRONIC PROGRAM GUIDE 

2. Claims 

1. A method foi operating an electronic program guide comprising the 
folio wing steps: 

collecting viewing preferences of a viewer; and 

developing a query for identifying programs based upon the viewing 
preferences of the viewer. 

2. A method as recited in claim 1, wherein the collecting step comprises 
the step of monitoring viewing habits of the viewer as an indication of the viewing 
preferences. 

3. A method as recited in claim 1, wherein the collecting step comprises 
the following steps: 

creating a viewer profile of the viewer; and 

correlating the viewer profile with other viewer profiles to infer the viewing 
preferences of the viewer. 

4. A method as recited in claim 1, further comprising the step of 
presenting, to the viewer, a list of programs identified by the query. 

5. A method as recited in claim 4, further comprising the step of 
ordering the list of programs to group programs which the viewer is more likely to 
watch in one part of the list and programs which the viewer is less likely to watch 
in another part of the list. 



6. A method as recited in claim 1, wherein the collecting step comprises 
the following steps: 

conducting the query; and 

assembling the programs identified by the query as a viewer program set 
through which the viewer can sequentially cycle. 

7. A method as recited in claim 1, further comprising the step of saving 
the query in a hierarchic query structure. 

8. An electronic program guide resident in a computer-readable storage 
medium and executable on a processor to perform the steps of the method recited - 
inclaim 1. 

9. A viewer computing unit programmed to perform the steps of the 
method recited in claim 1. 

10. A computer-readable storage medium which directs a computer to 
perform the steps of the method recited in claim 1. 

11. A method for operating an electronic program guide comprising the 
following stops: 

logging an amount of time that a particular channel is selected for viewing; 

generating a query to identify channels based upon a percentage of the time 
that the channels are selected. 



12. A method as recited in claim 1 1, further comprising the following 

presenting, to the viewer, a list of the channels identified by the query; and 
ordering the channels within the list according to the percentage of time that 
the channels are selected for viewing so that channels which are selected a higher 
percentage of the time appear at one place in the list and channels which are 
selected a lower percentage of the time appear at another place in the list. 

13. A method as recited in claim 11, further comprising the step of 
generating a query to identify channels which have been selected at least a - 
threshold amount of time to eliminate rarely selected channels from identification. 

saving the query in a hierarchic query structure. 

15. An electronic program guide resident in a computer-readable storage 
medium and executable on a processor to perform the steps of the method recited 
hi claim 11. 

16. A viewer computing unit programmed to perform the steps of the 
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17. A computer-readable storage medium which directs a computer to 
perform the steps of the method recited in claim 11. 

18. A method for operating an electronic program guide comprising the 
following steps: 

defining a first query for identifying programs preferred by a first viewer, 
defining a second query for identifying programs preferred by a second 

creating a unified query which combines the first and second queries to 
jointly identify the programs preferred by at least one of the first and second 

19. A method as recited in claim 1 8 , wherein the creating step comprises 
the step of combining the first and second queries according to a logical OR 
function. 

20. A method as recited in claim 18, further comprising the following 

conducting a search of programs available on the electronic program guide 
using the unified query; and 

presenting the programs that satisfy the unified query. 



21. A method as recited in claim 18, further comprising the step of 
automatically generating at least one of the first and second queries based upon 
viewing preferences of the respective first and second viewers. 

22. A method as recited in claim 18, further comprising the step of 
saving the queries in a hierarchic query structure. 

23. An electronic program guide resident in a computer-readable storage 
medium and executable on a processor to perform the steps of the method recited 

24. A viewer computing unit programmed to perform the steps of the 
method recited in claim 18. 

25. A computer-readable storage medium which directs a computer to 
perform the steps of the method recited in claim 1 8. 

26. A method for operating an electronic program guide (EPG) 
comprising the following steps: 

defining a first query for identifying selected programs in an EPG database; 

defining a second query for identifying selected programs retrievable from a 
site on the Internet; and 

creating a unified query which combines the first and second queries to 
jointly identify the selected programs, 



27. A method as recited in claim 26, farther comprising the step of 
saving the queries in a hierarchic query structure. 

28. An electronic program guide resident in a computer-readable storage 
medium and executable on a processor to perform the steps of the method recited 
ill claim 26. 

29. A viewer computing unit programmed to perform the steps of the 
method recited in claim 26. 

30. A computer-readable storage medium which directs a computer to" 

31. A method for operating an electronic program guide comprising the 
following steps: 

defining a query to identify a topic of interest to a viewer; 
storing the query; 

periodically executing the query to determine if there are any programs 
which relate to the topic; and 

automatically notifying the viewer when the query identifies a program 
related to the topic. 



32. A method as recited in claim 31, further comprising the step of 
automatically initiating procedures to record the program related to the topic. 



33. A method as recited in claim 31, further comprising the step of 
saving the query in a hierarchic query structure. 

34. An electronic program guide resident in a computer-readable storage 
medium and executable on a processor to perform the steps of the method recited 
in claim 31. 

35. A viewer computing unit programmed to perform the steps of the 
method recited in claim 31. 

36. A computer-readable storage medium which directs a computer to ' 
perform the steps of the method recited in claim 31. 

37. A method for operating an electronic program guide (EPG) as a 
viewer uses one or more numeric keys to enter data, individual ones of the keys 
also corresponding to one or more associated letters, comprising the following 

constructing a query, based on the entered data, which considers that the 
entered data might represent a number or a letter associated with the numeric key 

identifying any EPG data item that satisfies the query. 

38. A method as recited in claim 37, further comprising the additional 
step of repeating the steps of constructing and identifying for each key entry. 



39. A method as recited in claim 37, wherein the steps of constructing 
and identifying are performed after multiple key entries. 

40. A method as recited in claim 37, further comprising the additional 
step of presenting, to the viewer, said any EPG data item which satisfies the query. 

41. A method as recited in claim 37, wherein the constructing step 
comprises the following steps: 

formulating one or more letter sub-queries for each letter corresponding to 
the key used for entry; 

formulating a number sub-query for each number corresponding to the key" 
used for entry; and 

formulating the query as a combination of the letter and number sub- 

42. A method as recited in claim 37, wherein the data is a result of more 
than one key entry, and the constructing step further comprises the following^teps: 

interpreting the data for each key entry as representing both the number and 
the associated letters corresponding to the key; 

formulating multiple sub-queries for each sequence of key entries which 
considers different interpretations of the data within the sequence; and 

formulating a composite query as a combination of all the sub-queries. 



43. An electronic program guide resident in a computer-readable storage 
medium and executable on a processor to perform the steps of the method recited 

44. A viewer computing unit programmed to perform the steps of the 
method recited in claim 37. 

45. A coinputer-readahle storage medium which directs a computer to 
perform the steps of the method recited in claim 37. 

46. In a viewing computing unit which can be controlled through a - 
numeric keypad having numbered keys, the keys further corresponding to one or 
more associated letters, a method comprising the following steps: 

generating key data as a key is activated; 

interpreting the key data as representing Both a number associated with the 
key and the one or more letters associated with the key; and 

detennining possible operations which can be performed by the viewer 
computing unit far different interpretations of the key data. 



47. A method as recited in claim 46, wherein the numbers are used to 
identify a channel and the letters are used to identify a program or network name, 
the method further comprising the step of mapping the one or more letters 
associated with the key to the number associated with the key so that the channels, 
the program names, and the network names are all identified by numerically 
encoded key data. 

48. A method as recited in claim 46, further comprising the additional 
step of repeating the steps of generating, interpreting, and identifying as each key 

49. A method as recited in claim 46, wherein the interpreting and 
determining steps are performed only after the step of generating key data has been 
performed for all activated keys. 

50. A method as recited in claim 46, wherein the interpreting step 
comprises the following steps: 

formulating one or more letter sub-queries for each of the one or more 
letters associated with the key, 

formulating a number sub-query for the number associated with the key; 

formulating a composite query as a combination of the letter and number 
sub-queries. 



51. A method as recited in claim 46, wherein more than one key is 
activated, further comprising the following steps: 

generating a sequence of key data; 

formulating multiple sub-queries for the sequence of ley data which 
considers the different interpretations of the key date within the sequence; and 
formulating a composite query as a combination of all the sub-queries. 

52. A method as recited in claim 46, further comprising the step of 
saving the query in a hierarchic query structure. 

53. A viewer computing unit programmed to perform the steps of the - 
method recited in claim 46. 

54. A computer-readable storage medium which directs a computer to 
perform the steps of the method recited in claim 46. 

55. A method for operating an electronic program guide comprising the 
following steps: 

creating a restriction query having one or more search parameters; and 
precluding selection of any program, channel, or network which satisfies 
the search parameters in the restriction query. 



56. A method as recited in claim 55, wherein the search parameters are 
selected from a parameter group comprising genre, sub-genre, rating, time of day, 
and length of time watched. 

57. A method as recited in claim 55, further comprising the step of 
saving the query in a hierarchic query structure. 

58. A method as recited in claim 55, further comprising the step of 
saving the query as an icon. 

59. An electronic program guide resident in a computer-readable storage - 
medium and executable on a processor to perform the steps of the method recited 
in claim 55. 

60. A viewer computing unit programmed to perform the steps of the 
method recited in claim 55. 

61. A computer-readable storage medium which directs a computer to 
perform the steps of the method recited in claim 55. 

62. A method for operating an electronic program guide comprising tihe 
following steps: 

creating queries for locating a program, channel, or network; and 



63. A method as recited in claim 62, wherein the saving step comprises 
saving the queries as icons. 

64. A method as recited in claim 62, further comprising presenting, to a 
viewer, a organization chart representing the hierarchic query structure. 

65. A method as recited in claim 62, further comprising retrieving a 
query from the hierarchic query structure. 

66. An electronic program guide resident in a computer-readable storage 
medium and executable on a processor to perform the steps of the method recited " 
in claim 62. 

67. A viewer computing unit programmed to perform the steps of the 

68. A computer-readable storage medium which directs a computer to 
perform the steps of the method recited in claim 62. 

69. A computer-readable storage medium haying a hierarchic queTy 
structure stored therein which is formed as a result of the steps of the method 
recited in claim 62. 



a processor; and 



an electronic program guide (EPG) executing on the processor to organize 
programming information descriptive of programs, the EPG being configured to 
collect viewing preferences of a viewer and to automatically develop a query for 
identifying programming information based upon the viewing preferences of the 



71 . A viewer computing unit as recited in claim 70, further comprising a 
memory to store a profile of the viewer which indicates the viewer's 
characteristics, the EPG being configured to automatically develop the query based 
on the viewer profile. 



tile EPG being configured to log the viewer's viewing habits in the memory 
and to automatically develop the query based on the viewing habits. 



the EPG being configure! 
organized, hierarcluc structure. 



74. For execution on a processor of a viewer computing unit, an 
electronic program guide (EPG) executing on the processor to organize 
programming information, the EPG being configured to enable multiple viewers to 
create queries for locating particular programming information, the EPG further 
creating a composite query that combines the queries of the viewers. 

75. For execution on a processor of a viewer computing unit, the viewer 
computing unit having a display, an electronic program guide (EPG) executing on 
the processor to organize programming information, the EPG supporting a 
graphical user interface which can be shown on the display and being configured 
to periodically and automatically execute a query and to present on the user ~ 
interface a notification when the query is successful. 

76. An electronic programming guide as recited in claim 75, wherein 
while the display is showing a program, the EPG is configured to execute the 
query in background without interruption of the program. 



77. For execution on a processor of a viewer computing unit, wherein 
the viewer computing unit has numbered keys which additionally correspond to 
one or more associated letters, each key generating key data when a viewer 
activates the key to request programming information, an electronic program guide 
(EPG) executing on the processor to organize programming information, the EPG 
being configured to interpret the key data as representing both a number associated 
with the key and one or more letters associated with the key, the EPG being further 
configured to determine possible programming information that the viewer is 
hkely robe requesting based on different interpretations of the key data. 



3. Detailed Description of Invention 



television or interactive computing network systems, and to electronic program 
guides which operate in conjunction with these systems. More particularly, this 
invention relates to methods for operating electronic program guides using auto- 
generated and viewer-generated queries to identify programs or other 
programming information. 

BACKGROUND OF THE TIWF.NTIOX 

Television viewers are very familiar with printed programming schedules 
that appear in daily newspapers or weekly magazines, such as TV Guide®. The- 
printed program guide lists the various television shows in relation to their 
scheduled viewing time on a day-to-day basis. 

Cable TV systems often include a channel with a video broadcast of the 
printed program guide. The cable channel is dedicated to displaying listings of 
programs available on the different available channels. The listings are commonly 
arranged in a grid. Each column of the grid represents a particular time slot, such 
as 4:00 p.m. to 4:30 p.m. Each row represents a particular broadcast or cable 
channel, such as ABC, PBS, or ESPN. The various scheduled programs or shows 
are arranged within the rows and columns, indicating the channels and rimes at 
which they can be found. The grid is continuously scrolled vertically so (hat a 
viewer watches a continuously refreshing set of programs within three or four time 
slots. 

Data for available programs is typically received by a cable system as a 
plurality of data records. Each available program has a single corresponding data 

n 



record indicating a variety of information about the program such as its channel, ils 
starting and ending times, its title, names of starring actors, whether closed- 
captioning and stereo are available, and perhaps a brief description of the program. 
It is not difficult to format a grid such as described above from this type of data 
records. The grid is typically formatted once at the cable system's headend and 
broadcast repeatedly and continuously to the thousands of homes served by the 
cable system. 

Newer, interactive cable distribution systems feature electronic program 
guides (EPGs) which function somewhat similar to the broadcast program listing 
channels described above. Rather than scrolling automatically, however, an EPG 
allows a viewer to use a remote control device or other input device to scroll as - 
desired both horizontally and vertically through a program grid. This functionality 
utilizes the two-way commumcations capabilities of interactive cable systems. 

The EPG is typically implemented in software which runs on a set-top box 
(STB) connected between a TV and a cable system home entry line. When 
scrolling to a new column or row, Ihe set-top box inserts the appropriate 
programming information into each new row or column. This information is-either 
cached at the STB, or requested from the cable system's headend. 

Interactive systems permit viewers to control what programs are shown on 
their TV and when. Movies-on-demand is one example of this interactive control. 
A viewer can peruse a list of available movies from the EPG, and then order a 
selected movie. The STB sends a request for the movie to the headend server. 
The movie is retrieved and transmitted to the requesting STB. Movies-on-demand 
thus enables viewers to shop, purchase, and watch a movie at their convenience, as 



opposed to being restricted to certain start times as is typical with conventional 
premium or pay-per-view channels. 

Many industry and commercial experts expect entertainment systems to 
evolve to the point of offering many other interactive services to the consumers. 
For instance, consumers will be able to use their TV or computer to shop for 
groceries or other goods, conduct banking and other financial transactions, play 
games, or attend educational courses and take exams. 

Conventional distribution networks support many channels. It is common 
for a TV audience to have 50 to 100 channels. However, as technology improves 
and programming content continues to expand, the number of channels are 
expected to increase dramatically to many hundreds, or even thousands of- 
channels. 

One problem with the growth in the number of channels is that vastly 
enlarged selection, while appealing to a viewer, will make it more difficult for a 
viewer to locate programs of their preference. Traditional methods of locating 
programs — such as memorizing channel numbers, scanning program grids, or 
random surfing— will become less effective as the number of channels increase. 
For example, imagine the difficulty in trying to present hundreds or thousands of 
programs in a scrollable grid-like EPG user interface (UI), which might show only 
a few programs or channels at one time. This UI structure will most likely be 
unworkable for large program and channel offerings. Additionally, surfing 
through hundreds or thousands of channels will likely consume a large amount of 
time, causing the viewer to miss the programs he/she is attempting to find. 

It is also likely that the traditional practice of relating programs and 
networks to specific channels will become less meaningful as the number of 



channels increases. Suppose, for example, a viewer might be interested in 
watching football. Today, a viewer might remember that channel 6 (NBC) and 
channel 3 (FOX) carry the football games and simply tune to one of these 
channels. In the future, however, there might be football games being broadcast 
cm channels 78, 495, and 1042. These channels might he small local stations that 
are broadcasting their local football team, or one of many channels used by a 
major network. Viewers are not likely to remember that channels 78, 495, and 
1042 are carrying football games at specific times. 

Moreover, the correlation of channels to networks and programs vary from 
market to market. For instance, the sports network ESPN might be carried on 
channel 15 in one market and on channel 29 in another market. Memorizing- 
program offerings in terms of channel numbers will prove frustrating as a viewer 
travels from one market to the next 

Accordingly, there is a need to develop operating methods which allow 
viewers to easily find programs or networks regardless of the channels on which 
they are carried. Additionally, these operating methods should enable viewers to 
locate programs regardless of whether they remember the channel number, 
program name, or network name. 

Toward this end, a company named TVHost, Inc. has developed a software- 
based product "ETV" which assists a viewer in locating particular programs. The 
ETV system organizes the different program offerings according to different 
topical categorizes. Fig. 1 shows an example screen display of a graphical user 
interface (UI) window 20 supported by the ETV system. The ETV window 20 has 
a first pane 22 that lists alphabetically predefined types of programs, such as 
Business, Children, Educational, Game Shows, and so forth. The viewer can 



control a focus frame or highlight bar 24 to choose a type of program from the first 
pane 22. A second pane 26 contains a list of programs that are available for the 
program type highlighted in the first pane 22. In this example, the type "business" 
is highlighted, and hence business-related programs are shown in the second pane 
26. The second pane 26 also provides other programming information including 
start time, network or station, and duration. 

The ETV system thereby offers an alternative to a scrollable grid 
presentation which organizes programs according to type. This allows the viewer 
to select aprogram type, and then review the programs offered for this type. The 
ETV system also permits rudimentary "search" capabilities. Fig. 2 shows another 
graphical UI window 30 which appears when performing a search. A first pane 32 - 
contains a scrollable alphabetized hat of stations, and allows a viewer to choose a 
station. A second pane 34 contains a scrollable alphabetized list of program types 
from which the viewer may select a program type. Other parameters, such as 
MPAA, rating, and start time, can also be selected by the viewer. Based upon 
these selections, the ETV system locates programs which are of a particular type, 
from the selected station, and satisfy the ratings and start times. 

The ETV system is limited in many respects. The ETV system does not 
permil searches on arbitrary fields. Instead, the categories ate predefined for the 
viewer. The viewer is not able to define his/her own complex searches using, for 
example, Boolean logic of "OR," "AND," and "NOT." Another limitation is that 
the ETV system does not provide any active controls which intelligently narrows 
selections based upon viewer selections. An "active" control is a control that does 
not require any other action on the part of the user. For instance, if a viewer 
selects a station in pane 32 of the search window 30 (Fig. 2), all program types will 



be listed in the'second pane 34. In fact, the same lists will always occur in both the 
first and second panes 32, 34 regardless of what selections the viewer has 
previously made. The viewer is not able to see any results until the viewer 
activates a "Begin" search key 36. 

Accordingly, there remains a need to develop operating methods which 
decouple associations between the channel and network or program and also allow 
intelligent search procedures to better assist the viewer in locating preferred 
programs. 

SUMMARY OF THE INVENTION 

This invention concerns an electronic program guide (EPG) which enables - 
creation of queries to facilitate simple and complex searches across predefined and 
arbitrary fields. The EPG organizes and presents programming information to a 
viewer. The EPG is implemented in software which executes on a processor 
resident in a viewer computing unit. As described herein, the viewer computing 
unit can be implemented as a set-top box (STB) connected to a television (TV), as 
a computer and monitor, or the like. 

According to one aspect of this invention, the EPG is configured to 
automatically identify programs that a viewer is likely to prefer. The EPG collects 
viewing preferences of a viewer by, for example, monitoring and logging viewing 
habits of me viewer or through creation of a viewer profile in which a viewer 
answers a series of questions designed to discover the viewer's likes and dislikes. 
Based upon the these viewer preferences, the EPG automatically develops queries 
for identifying programs that the viewer is likely to watch and presents those 
programs to the viewer. 



The EPG can farther be configured to merge the queries of individual 
viewers into a composite query which searches for programs on behalf of all 

member might define a query for college basketball games, another family 
member might define a query for Civil War programs, and another family member 
might define a query for cartoons. The EPG then creates a unified query which 
combines the three queries to jointly identify programs which satisfy any one of 

directories to organize the queries. For instance, a viewer might arrange queries" 
for different kinds of movies within a Movie directory and queries for sports 
within a Sports directory. Another example organization is to arrange queries 
within separate user directories. 

According to another aspect, the EPG is configured to run queries in 
background so that the queries are periodically executed unbeknownst to the 
viewer. When the EPG identifies a particular program satisfying the background 
query, the EPG automatically notifies the viewer of the program and/or 
automatically initiates procedures to record the program. For example, suppose a 
viewer wants to watch shows on the Great Wall of China. The viewer can define a 
query for identify any programs mentioning the Great Wall and have the query 
execute in background, perhaps for a long duration of time. As the EPG identifies 
programs on the Great Wall, the EPG notifies the viewer of when the program is 
scheduled to be shown, and to initiate recording procedures. 



According to another aspect of this invention, the EPG assists a viewer in 
finding a program, channel number, or network by using a 10-kcy keypad as 
typically found on remote control handsets. The keypad has ten numerical keys, 
which also correspond to associated letters. When the viewer presses a key, the 
viewer might intend to be entering a number to find a channel, or one of the letters 
associated with the key for spelling the program or network name. Regardless of 
the viewer's intent, the data generated when the key is depressed is the same. The 
EPG is configured to interpret the data as representing all possible choices, 
including the number and letters associated with the key. For instance, when a 
viewer depresses the number "5" key, the EPG interprets that data to mean "5" or 
"J" or "K" or "L." The EPG then identifies programs, channels, and networks" 
which begin with or contains the number or letters. As the viewer continues to 
enter each digit, the list of programs, channel, and networks dynamically narrows. 
After a few button presses, the viewer is presented with a short Hst of possible 



PET A I LED DESCRIPTION OF TfTF frbthrhkw KMRnmiOTNT 

Fig. 3 allows an entertainment system 40 according to one implementation 
of this invention. System 40 includes a centralized headend or content provider 42 
which is configured to provide continuous video content programs to multiple 
subscribers. Programs provided by content provider 42 might include traditional 
broadcast TV shows, on-demand movies, games, and other services such as those 
commonly provided m the past by on-line computer services. 

The content provider 42 supplies video and other data over a distribution 
network 44 to the subscribers. In this implementation, the network 44 is a satellite 
network which transmits the data in a digital format from the content provider 
directly to individual subscribers. The satellite network 44 includes a transmitter 
46, an orbiting satellite 48, and a receiver 50. As one example, the satellite 
network 44 can be implemented using DSS (Direct Satellite System) technology, 
where individual subscribers own small 1 8" receiving dishes 50 which are resident 
at their homes. Video, audio, and other data are transmitted in digital format from 

to the satellite receiver 50. 

The distribution network 44 can be implemented in other ways instead of 
DSS technology. One implementation is a multi-tier network which includes a 
high-speed, high-bandwidth fiber optic cable network between the content 
provider 40 and regional distribution nodes (not shown), and canvaniimifil h<w 



entry lines, such as twisted-pair lines or coaxial cable, between the distribution 
nodes and viewer computing units 60. Anther network implementation might 
include traditional RF broadcast technologies. The network can also be 
constructed using a combination of wireless and wire-based technologies. 

Another approach beside to broadcasting the content to the subscribers is by 
multicasting the content over the Internet. With this approach, the content 
providers transmit the data content to a designated multicast address on the 
Internet. Subscribers listen to the multicast address to receive the primary content. 

Each subscriber residence has at least one viewer computing unit 60. In the 
illustrated implementation, the viewer computing unit 60 is embodied as a 
broadcast enabled personal computer, or simply "broadcast PC." The broadcast - 
PC 60 has a large computer monitor 62, a processing unit 64, and input devices in 
the form of remote keyboard 66 and/or remote control handset 68. The remote 
keyboard 66 and handset 68 are remotely coupled to the processing unit 64 via a 
wireless data link 70, such as infrared (IR) or radio (RF), although the remotes can 
be directly connected. The broadcast PC 60 also includes an EPG database 72 and 
a content separator 74, which are shown separately for illustration purposes, but 
can be incorporated into the processing unit 64. 

It is noted that the viewer computing unit 60 can be implemented in other 
forms. For instance, the viewer computing unit 60 can be embodied as a set-top 
box coupled to a conventional television. Another implementation includes a TV 
or other visual display device, which has processing components incorporated 

Content provider 42 is configured to originate the broadcast programs or to 
rebroadcast programs received from another source, such as a satellite feed or 



another cable "system. In addition, the content provider 42 is configured to 
maintain a database of programs 80, such as feature-length movies, past TV 
shows, games, and other entertainment videos, which can be played individually to 
requesting subscribers in an on-demand mode. These programs can be requested 
via a back channel, such as a telephone link or Internet link (described below). In 
the case of a cable based network, the cable might function as both distribution 
channel and back channel to support interactivity. As technology continues to 
improve, the receiver 50 might be replaced with a transceiver which is capable of 
both receiving digital data from the satellite system, and transmitting data back 
across the satellite system. 

The content provider 42 includes a continuous media server 82 which- 
distributes the digital video data streams kept in the programs database SO. The 
continuous media server and video program database are implemented, for 
example, as a disk array data storage system consisting of many large capacity 
storage disks. The video data streams of the movies are stored digitally on the 
storage disks in predetermined or mapped locations. The locations of the video 
data streams are kept in a memory map and each video data stream is accessed 
through pointers to the particular memory location. The continuous media server 
can service simultaneous requests for a program (even the same program) from 
many viewers. 

The content provider 42 also has an program information server 84 to serve 
programming information to the viewer computing unit 60. The program 
information server 84 is implemented as a structured query language (SQL) 
database 86 with records containing information relating to available shows or 
programs. 



Fig. 4 shows an example data structure 88 for organizing programming 
information within the EPG database 86. The data structure includes various data 
fields 90 for holding programming information. The data fields contain program 
titles, actor names, whether the program has closed captioning or stereo audio, the 
scheduled time of the program, the network name, description text, and the like. 
The data structure 88 holds pointer to locations within the storage subsystem of the 
continuous media server 82 which identify storage locations of the programs 
corresponding to the program records. 

The data structure 88 might also contain target specifications (memory 
pointer, hyperlink, etc.) to one or more target resources which maintain 
supplemental content for the programs. The supplemental content can be stored at, - 
and served from, the content provider 42 or from an independent service provider. 
The supplemental content can be text, hypermedia, graphics, video, picture, sound, 
executable code, or other multimedia types which enhance the broadcast program. 
Examples of possible supplemental content include interactive questions or games 
related to the program, additional trivia on the movies or TV shows, 
advertisements, available merchandise or other memorabilia, Web pages to 
programs of similar type or starring the same actors/actresses, and so on. 

With reference again to Fig. 3, the content provider 42 broadcasts multiple 
programs for different networks and channels as one continuous digital data feed, 
as is conventional in DSS. The EPG programming information is transmitted 
along with the video and audio data. The data is compressed and placed in digital 
transport packets for transmission over the satellite system. If desired, the data 
pertaining to particular channels or programs can be scrambled. The receiver 50 
de-scrambles and decompresses the data stream, and then reconstructs the video, 



audio, and programming data from the digital transport packets. The content 
separator 74 separates die video and audio data from the programming 
information. The video/audio data is directed to a tuner in the viewer computing 
unit 60 which selects a particular channel and displays the video on the monitor 62 
and plays the corresponding audio. The viewer controls program selection using 
the keyboard 66 or remote control handset 68. The programming information is 
input to the EPG database 72. By caching the programming information in the 
local EPG database 72, interactive functionality used to locate and select certain 
programs from the EPG is handled locally. 

(ISP) 92 which distributes digital content to the viewer computing unit 00 over a - 
second network 94. An example of the second network 94 is a public network, 
such as the Internet. The ISP 92 has an ISP host 96 and a content database 98 to 
serve various multimedia content to the user. For instance, the ISP host 96 might 
store one or more target resources (such as a Web page) that can be rendered by 
the viewer computing unit 62 . 

According to the Fig. 3 arrangement, the viewer computing unit 60 receives 
traditional broadcast, on-demand programs, and progranrrning information from 
the content provider 42. The viewer computing unit 60 also receives supplemental 
interactive content from the content provider 42 or from the independent service 
provider 92. The back channel for facilitating interactive control is provided 
through network 94. The off-site supplemental information provided by the ISP 
92 is correlated with the programs within the program records data structure 88 in 
program information server 84. As shown in Fig. 4, programs with supplemental 
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content provided by other sen-era has a target specification listed in one of the data 
fields. 

in mote detail. It includes a mother board 100 having a processor 102 (e.g., x86 or 
Pentium® microprocessor from Intel Corporation), a volatile memory 104, and a 
program memory 106. The viewer computing unit 60 includes a digital broadcast 
receiver 50, such as a satellite dish receiver (Fig. 3). The digital receiver 50 
receives digital data broadcast over the satellite distribution network 44. The 
receiver 50 is coupled to a tuner 110 which tunes to frequencies of the satellite 
transponders in the satellite distribution network. The tuner 110 has one or two 
primary components: a specialized digital broadcast tuner and/or a generalized - 
digital broadcast tuner. The specialized digital broadcast tuner is configured to 
receive digital broadcast data in a particularized format, such as MPEG-encoded 
digital video and audio data. The generalized digital broadcast tuner is configured 
to receive digital data in many different forma, including software programs and 
programming information in the form of data files. 

The tuner 110 is connected to the mother board 100 via a multi-bit bus 1 12, 
such as a 32-bit PCI (Peripheral Component Interconnect) bus. The EPG database 
72 is shown connected to the PCI bus 1 12, but can alternatively be implemented as 
part of a hard disk drive 146. The programming data received at the receiver 50 is 
transferred over the PCI bus 1 12 to the EPG database 72. A decryption device (rot 
shown) for facilitating secure access to the broadcast enabled PC may also be 
attached to the bus 112. 

The viewer computing unit 60 has a video subsystem 114 connected to the 
PCI bus 112. The video and audio data is transferred from tuner 110 over PCI bus 



1 12 to the video subsystem 1 14. The video subsystem 1 14 includes circuitry for 
decoding MPEG-encoded or other video data formats, although such circuitry can 
alternatively be incorporated into the tuner 110 or motherboard 100. The video 

The video subsystem 114 supports many peripheral devices, in addition to 
the monitor 116. For instance, the video subsystem 114 might be connected to a 
laser video player 1 1 8 for playing DVD (digital video disks), a game machine 1 20 
for playing video games, and a VCR (video cassette recorder) 122 for recording 
programs. The video subsystem 114 is adapted for connection to an analog 
broadcast television system 124 to receive conventional TV signals fiom cable - 
television or RF broadcast television systems. This enables backwards 
compatibility to analog TV systems. 

The monitor 1 1 6 is preferably a VGA or SVGA monitor as is customary for 
personal computers, as opposed to a standard television. In the illustrated 
implementation, the viewer computing unit 60 does not convert the television- 
related data into an NTSC (National Television System Committee) format. In 
this manner, the viewer computing unit 60 is able to produce television data having 
superior quality when displayed on the VGA monitor. 

The viewer computing unit 60 also includes a second bus 130, such as an 
ISA (Industry Standard Architecture) bus, coupled to the mother board 100. An 
audio board 132 is coupled to the ISA bus 130 and serves as an interface with a 
number of audio output devices, such as conventional speakers. An amplifier may 
he coupled between the audio hoard and speakers if desired. The audio board is 
also coupled to the video subsystem 114 to receive decoded audio signals. The 



audio board 132 can be coupled to a stereo system 134, so that audio data can be 
output to the stereo system for enhanced sound and recorded. 

A CD ROM drive 136 is coupled to the ISA bus 130. The audio output 
produced by the CD ROM drive 1 36 is passed to the audio board 132. 

The viewer computing unit 60 includes a modem 138, such as a 14.4 or 
28.8 kbps fax/data modem, coupled to the TSA bus 130. The modem 138 is 

including the Internet. The modem 138 can be used to access and download data 
and supplemental content directly from an independent service provider. 
Additionally, the modem 138 can be used for two-way communications with the 
content provider serving the programs over me DSS network. Viewer requests for - 
programs can be transmitted over the back channel via the modem 138. 

An inpul/output (I/O) adapter 140 is coupled to the ISA bus 130 to interface 
with numerous I/O devices , including a digital tape driver 142, a floppy disk drive 
144, and a hard disk driver 146. A remote receiver 148 is also coupled to the I/O 
adapter 140 for receiving signals from the remote cordless keyboard 66 and remote 
control handset 68 in an IR or RF format. Alternatively, the keyboard and handset 
can be directly wired to the computer. The I/O adapter 140 further provides 
conventional serial ports, including a COM1 port 150, a COM2 port 152, and an 
LPT1 port 154. An IR transmitter (not shown) can be coupled to the COM1 port 
150 to generate infrared signals to control electronic devices, such as stereo 
equipment, VCR, and the like. The computer 60 can also be hooked directly to 
these components. 

The viewer computing unit 60 runs an operating system 1 60 which supports 
multiple applications. The operating system 160 is loaded in memory 106 and 



executes on the processor 102. The operating system 160 is preferably a 
multitasking operating system which allows simultaneous execution of multiple 
applications. The operating system 160 employs a graphical user interface 
windowing environment which presents the applications or documents in specially 
delineated areas of the display screen called "windows." One preferred operating 
system is a Windows® brand operating system sold by Microsoft Corporation, 
such as Windows® 95 or Windows® NT or other derivative versions of 
Windows®. The remote keyboard 66 and handset 58 may include customized 
keys suitable for use with a Windows® brand operating system. It is noted, 
however, that other operating systems which provide windowing environments 
may be employed, such as the Macintosh operating system from Apple Computer, - 
Inc. and the OS/2 operating system from IBM. 

A channel navigator application 162 is stored in program memory 106 and 
executes on the processor 102 to control the tuner 1 1 0 to select a desired channel 
for receiving the video content programs. An EPG application 164 is stored in 
program memory 106 and executes on the processor 102 to organize programming 
information downloaded from the Program information server at the content 
provider and cached in the EPG database 72. The EPG 104 supports a displayatle 
user interface (VI) which visually presents the programming information from the 
EPG database 72 in a usable format for the viewer, as will be described below with 
reference to Fig. 6. The EPG is also configured to enable the viewer to define 
queries which intelligently identify and gather programs the viewer would like to 

The viewer computing unit 60 has a browser 166 which is kept in memory 
106 and dynamically loaded on processor 102 when needed to render content, such 



as a hypertext "document, from an ISP or other content provider. The browserl66 
can be implemented as a hyperlink browser, or more particularly, as an Internet 
Web browser. 

It is noted that the operating system and applications can be stored on the 
haTd disk driver 146, or other storage medium (floppy disk, CD ROM, etc.), and 
loaded into the program memory for execution by the processor. 

It is further noted that the broadcast enabled personal computer 60 is a fully 
functional computer which can perform the typical desktop applications familiar to 
computers. A variety of different applications can be loaded and executed on the 
viewer computing unit. As an example, the viewer can ran word processing 
applications, spreadsheet applications, database applications, scheduling - 
applications, financial applications, educational applications, and so forth. The 
viewer operates the applications using the keyboard 66. 

Fig. 6 shows an example EPG UI 170 which is presented on a display 1 72. 
The EPG UI 170 includes a channel panel 174, a time panel 166, a program grid 
178, and a program summary panel 180. Channel panel 174 provides a vertical 
scrolling list which displays multiple channel Sles 182 at any one time. Each 
channel tile 182 includes a channel number and a channel name (typically the 
network name, such as CBS, ABC, MTV, etc.), and might also include a channel 
logo. The channel panel 174 defines rows of program titles in program grid 178. 
Time panel 176 is a horizontal, continuous scrolling time line with markings 
denoting half-hour time segments. Time panel 176 defines columns in program 
grid 178. 

Program grid 178 consists of multiple program tiles 184 organized in 
channel-based y-axis and time-based x-axis. The grid is located to the right of 



channel panel 174 and below time panel 176. Each program tile 184 has the 
program tide and any secondary program descriptive information, such as closed 

for 8:00 p.m. to 10:00 p.m. PST, Thursday, March 7, 1996. The program titles, 
such as "Murder, She Wrote" and "Friends," are arranged horizontally with respect 
to their networks CBS and NBC and vertically with respect to their start times of 
8:00 p.m. PST. It is rioted that many other grid or non-grid layouts may be 
employed to present the program selections 1o the viewer. Additionally, although 
the layout is shown organized according to channel number, the same information 
can be presented in a channel absence presentation where no reference is made to 
channel numbers. 

The viewer controls the program selection with a single focus frame 186 
which is graphically overlaid on the program grid 178. Focus frame 186 can be 
moved up or down, or left and right within a channel line-up, to choose a desired 
program. The remote control handset or keyboard (or other manipulating 
mechanism) can be used to position the focus frame 186 within tfic EPG UI 170. 

Program summary panel 180 includes a text description window 188-and a 
preview window 190. The text description window 188 displays program 
information related to the program that is highlighted by the focus frame 186 in 
program grid 178. Here, the NBC program "Seinfeld" is highlighted and the text 
description window 188 lists the program title "Seinfeld," and a program 
description of the current episode. The text description window 188 might also 
include other program related information like closed-captioning, stereo, etc. The 
preview window 190 is used to display clips of the selected highlighted show, such 
as a preview of the "Seinfeld" show. 



The data to fill the various tiles and windows is drawn from the EPG 
database 72 or from URL resources on the Internet 94. The data is maintained in 
data structure 88 (Fig. 2) which is transmitted as program records from the content 
provider over the satellite network to the viewer computing unit and cached in the 
EPG database 72. The EPG application 164 inserts the appropriate data records 
into the EPG UI 170 for display as the viewer maneuvers the focus frame 186 
around the grid. 

The EPG Ul 170 also includes hyperlinks 192 which are supplied with the 
program records received from the content provider, embedded in the program 
stream, or provided in a data stream from arbitrary source which has teen 
associated with the program. The hyperlinks can be inserted into the channel tiles - 
182, program tiles 184, or the description window 18S. In the Fig. 6 illustration, 
the hyperlink "More" is provided in the description window 1 8 8 to reference target 
resources that contain additional information about this episode of the "Seinfeld" 
show. Other hyperlinks in the description window 188 include "Last Week" 
which references a target resource containing information on the previous week 
episode, and "Comedy Club* which links to a target resource having «deo 
coverage of comedian Jerry Seinfeld performing at night clubs. The target 
resources referenced by the hyperlinks might be located at the content provider or 
at an independent service provider. The target resource might further he located 
locally, having been pre-cached by the system. For instance, the system might prc- 
cache supplemental infbrmatioa about certain shows before they air based on 
predictive viewing tendencies, or as part of a promotional data broadcast 
advertising the show. This permits local interactive functionality between the 



viewer and the viewer computing unit, in addition to full network interactive 
functionality between the viewer and the program provider. 

The EPG UI 170 has special operator buttons 194-200 which arrange for 
certain tasks. A "view full screen" button 194 allows trie viewer to view the 
program in full screen. A "record" button 196 allows a user to initiate procedures 
to record a currently playing program, or schedule to record an upcoming program. 
For scheduling, the viewer simply drags the record icon and drops it on a program 
tile 1 84 of an upcoming program, as exemplified by the record icon dropped on the 
"Caroline in the City" program tile. 

A "remind" button 198 is used to set reminders which notify viewer's of 
scheduled shows. A viewer might for example, want to be reminded of a program - 
being played later in the day and hence, drag a reminder icon to the suitable 
program tile 184. When the start time of the requested program approaches, the 
EPG will notify the viewer through a pop-up icon or the like that the program is 
about to begin. An "add to favorite" button 200 is provided to enable a viewer to 
add a program to a predefined list of favorites. 

The drag and drop aspects described above are preferably implemented 
using object linking and embedding (OLE), which is commerciaUy available from 
Microsoft Corporation under a technology known as "ActiveX." OLE is an 
extensible service architecture built on the Component Object Model (COM) 
which is both language independent and location independent OLE supports an 
OLE Drag and Drop which is widely used in WindowsO-compatible operating 
systems, such as Windows® 95. OLE and COM have been well documented and 
will not be explained in detail. For more information regarding OLE and COM, 
refer to OLE 2 PToipammer's Referent and Inside OT.K 2, ??ecntid F,diHrm, both 
Si 



published by Microsoft Press of Redmond, Washington, and both of which arc 
hereby incorporated by reference. 

The EPG UI 170 also presents predefined query buttons 202-210. 
Activation of these query buttons trigger a query of the EPG database 72 to 
identify programs satisfying the predefined query parameters. The EPG 106 
enables a viewer to create their own queries and to produce a sort button on the 
EPG UI 170 for quick retrieval of highly used queries. As an example, the EPG 
UI shows queries for favorite programs, Star Trek programs, comedies, the Oprah 
Show, and old movies. The "favorites" query button 202 recalls a list of programs 
that the viewer has previously identified as favorites using the "add to favorite" 
button 200, or which have been automatically defined as favorites by the EPG.- 
The "Star Trek" query button 204 and "Oprah" query button 208 initiate queries of 
the EPG database 72 for all Star Trek and Oprah shows that might be playing 

programming grows dramatically, several different channels might carry Star Trek 
or Oprah, concurrently or at different times. The "comedies" query button 206 
initiates a query of the EPG database 72 for all comedy programs. The "old 
movies" query button 210 locates all old movies that are showing. 

Some of the predefined query buttons are preset categories, such as the 
"comedies" and "old movies" buttons, while other query buttons are defined by the 
viewer, such as "Star Trek" and "Oprah" buttons. The preset category buttons can 
be added and removed from the EPG UI through a separate window which allows 
a viewer to add or subtract categories from a list of available categories. 

According to one aspect of this invention, the EPG 164 is configured to 
automatically develop queries to identify programs that a viewer is likely to want 



to watch based on viewing preferences of the viewer. The EPG application 
collects viewer preferences in a number of ways. One technique is to log the 
amount of time that each channel is selected for viewing, with the underlying 
assumption that the viewer is watching that channel. Each channel is then 
assigned its own percentage of the entire viewing period as an indication of the 
viewer's preferences. The EPG generates a query to identify channels based upon 
this percentage, so that channels which the viewer tends to watch most often 
appear at the top of the list and channels which the viewer tends to watch least 
often appear at the bottom of the list. The EPG presents this list as a scrollable list 
in the EPG UI , with the highly watched channels appearing at the top and the least 
watched not appearing at all, but being available if the viewer wanted to scroll to - 
them. It is noted that the same technique can be applied to individual programs or 
networks, where each program or network (rather than channel) is logged and the 
list is ordered with the frequently watched programs being listed on top and the 
least watched programs being listed on the bottom. 

Another teohnique is to create a viewer profile for each viewer. The viewer 
is asked a series of questions directed at discovering the viewer's likes and 
dislikes. This question- and-answer session is accomplished using a separate 
graphical UI which asks questions and enables viewers to choose among 
responses, such as "strongly like," "like," "dislike," and "strongly dislike." Rather 
than discrete answers, the question-and-answer screen might include sliders which 
enable viewers to choose somewhere in a scale between opposing preferences of 
"strongly dislike" and "strongly like." The EPG compiles the viewer profile and 
correlates the profile with clustering data to generate a query for possible 
programs. The clustering data represents an accumulation of other viewers 



preferences. By matching the viewer profile with similar profiles, the EPG can 
tetter determine what the viewer will most likely want to watch. 

Once the EPG 164 has automatically compiled a list of likely favorites, the 
EPG presents the list in a UI screen. This screen can be called, for example, by 
activating the "favorites" button 202 in EPG UI 170. The list is presented as its 
own reduced, closed loop of available programs which has actively weeded out 
less popular channels. The viewer can then surf the closed list by sequentially 
cycling through the programs. 

The EPG UI 170 also presents a "Find" button 212 which, a viewer uses to 
create his/her own query. Activation of the "Find" button 212 opens another UI 
window which assists a viewer in creating a query. Fig. 7 shows an example find * 
window 220. The find window 220 presents various search parameters for the 
viewer to search. In this example, the viewer can select a program genre from a 
genre box 222, a program sub-genre from a sub-genre box 224, a rating from the 
rating scale 226, a network name from the network box 228, and a program name 
from the program box 230. Based on these parameters, the EPG constructs a query 
and searches the EPG database 72 to locate programs satisfying the query,- The 
find window supports creation of two mutually exclusive types of queries: a 
"find" query which locates all programs satisfying the search parameters and a 
"find all except" query to locate all programs which do not satisfy the parameters. 
In this example, the EPG has constructed a "find" query which located three 
programs that satisfy the parameters of an action movie rated PG. 

To produce more advanced queries, the viewer can select an advanced 
query button 232. Fig. 8 shows an example advanced find window 240. It enables 
a viewer to create paruVularized queries and organize them in a tabbed folder 



arrangement. In this example, the viewer has defined three advanced queries 
pertaining to "G-rated" programs, "Action" programs, and "No Sci-Fi" programs. 
The advanced End window 240 includes parameters such as genre, sub-genre, 
rating, network name, channel, program name, and time period. As new 
parameters are added to the BPG datahasc, new controls in the advanced find 
window 240 are likewise added. It also allow a viewer to define a keyword. In 

between 5:00 PM and 8:00 PM. Hence, the viewer enters the keyword "Bond" and 
executes the query. If the viewer wanted to find a particular bond movie starring 
Sean Cormery, the viewer might enter a Boolean-like search "Bond AND 
Connery" in the keyword control of the advanced find window. 

The advanced find window 240 can also be used to create restrictive queries 
which function to restrict or limit selection of programs for viewers without 
appropriate permissions levels. For instance, parents can set permission levels for 
their children so that when the children are logged onto the viewer computing unit, 
the children are prevented from watching certain programming content or from 
ordering certain services. A parent might, for example, wish to restrict a- child 

clicks the "don't find" option to convert the query from an inclusive query to an 

An "add tab" button 242 and "remove tab" button 244 allow the viewer to 
manage the queries. The viewer can also save queries by clicking on the "save" 
button 246. Preferably, the queries are saved in a hierarchic query structure of the 
EPG database. This enables viewers to define directories and sub-directories of 
queries. Organizing queries in a hierarchic structure is advantageous because the 



structure conforms to the computer side of the viewer computing unit and avails 
itself to memory management applications and tools running on the computer. As 
the number of saved queries grow, the query directories can be searched like other 
data files directories, as is common in personal computers, to locate a particular 
query. The query structure can also be presented in a UI to the viewer as an 
organization chart showing the hierarchy of directories, sub-directories, and 
queries. Individual queries can be saved as icons. To recall the query, the user 

The EPG can also be configured to support a query editor to allow the 
viewer to create essentially any type of query based on key word descriptions, and 
to edit such queries. One suitable type of editor which can be employed with the " 
EPC is a query editor used in a program entitled Cinemania95 by Microsoft 
Corporation, which enables a computer user to create queries for locating cinema 
trivia stored on the CD ROM. 

To assist the viewer in defining a query (either by using the "Find" UI or 
the query editor), the EPG can provide wizards which guide the viewer with step- 
by-step instructions through the query creation. One example wizard for 
generating a simple query is to ask the viewer if the program selected is chosen for 
its name, or for its channel. A viewer might request to always be shown any 
program with one name, or to never display a program with another name. 

Once a query is defined, the viewer can execute the query to initiate a 
search of the programming information in the EPG database 72. The queries 
function as a filter which sifts through the programming information and returns 
only those items which satisfy the parameters, or in the case of a restrictive query, 
precludes those items that satisfy the parameters. 



Tig. 9 is a diagrammatic illustration of how a query operates to filter out 
programs which do not satisfy the criteria. Box 250 contains a representation of 
programs found in the EPG database 72. Suppose a viewer defined a science 
fiction (Sci-Fi) query using the advanced find window 240, as shown in Fig. 8, to 
locate Sci-Fi programs. The EPG application 164 executes the Sci-Fi query 252 
and winnows the program database to a short list of Sci-Fi programs, as presented 
in box 254. This short list of Sci-Fi programs is then presented in the UI as a 
closed loop list which can be cycled by the viewer for selection of a particular 

Fig. 10 demonstrates a restrictive query which functions to filter out and 
remove programs which are prohibited under the query. In this example, the EPG ' 
applies a restrictive query filter 256 to the program set 250 in the EPG database 
which eliminates programs rated PG or R. The short list provided in box 258 is 
without PG or R rated programs. 

Figs. 1 1 and 12 illustrate another aspect of this invention in which the EPG 
is configured to merge multiple queries into a unified query. Suppose, for 
example, that multiple members in a family want to watch a program together, but 
are not sure which program. Typically, each family member individually scans the 
program listings, or surfs the channels, to find one or two programs they are most 
interested in watching. After everyone is through with his or her independent 
search, they discuss about which program to watch. The EPG 164 eliminates this 
problem by creating complex composite queries which merge multiple simple 

Fig. 11 shows an example UI window 260 having a folder organization 
which maintains queries for individual viewers. In this example, a family of 



four— Dad, Mom, John, and Sue — each have their own tab and folder which lists 
their personalized queries. That is, each family member has previously defined 
one or more queries and stored them in their personal folder. The Mom folder 
holds queries for musical programs, programs on France, and the Seinfeld 
program. Table 1 shows the queries for all family members. 




When the femily sits down to watch a program together, one viewer can 
execute a merge query that effectively combines these independent queries using, 
for example, an OR function. The Boolean OR function returns a true result if any 
one of the parameter sets is met In Fig. 12, a program set 262 is filtered -using 
Dad's query Mter(s) 264, Mom's query filters) 266, John's query filter(s) 268, 
and Sue's query filters) 270. The programs satisfying at least one of these queries 
is placed in the program poo! 272, from which the family members can choose a 
program, ft is noted that the family filter can be alternatively set to combine using 
a set intersect method or Boolean AND function which returns a program only if 
the query parameter sets of each family member is met. 

Notice that some programs are listed because they satisfy a single query 
(e.g., US Open Golf is selected by Dad's query filter 264). Other programs may 



satisfy more than one query. For example, the program "Seinfeld" satisfies Mom's 
Seinfeld query and Dad's comedies query. The animated movie "Aristocats" 
satisfies Mom's Fiance query and Sue's cartoon query. 

Fig. 13 illustrates the data flow for the programming data used by the EPG 
application, and how the query filters act to pare the data. Suppose that the viewer 
is watching the viewer computing unit 60 at 1:00 PM, as indicated by the clock 
280. Broadcast digital video and audio data, along with the digital programming 

programming data is cached in the local EPG database 72. In this illustration, the 
EPG database is shown as having twelve programs with start times ranging from 
1 :00 PM to 8:00 PM. This represents a tiny fraction of available programs, as the - 
EPG database 72 can store thousands of programs that are available over hundreds 
to thousands of channels. 

The viewer has defined a restrictive query 282 that removes all Sci-Fi 
programs from the active EPG UI 170. In this case, the programs "Star Trek," 
"Aliens," and "Star Wars" are eliminated from the EPG UI 170. Now, suppose the 
viewer decides to watch CNBC Market Wrap at 1:00 PM. The viewer selects the 
program by highlighting and clicking on the Market Wrap program rile in the EPG 
UI 170. The tuner in the viewer computing unit tunes to the channel carrying the 
selected program and the digital video data for Market Wrap is sent to the VGA 

According to another aspect of this invention, the viewer can define queries 
that continue to execute in background. The viewer defines the query to identity a 
topic of interest, such as any programs concerning the Great Wall of China or any 
programs starring Clint Eastwood. The query is stored and periodically executed 



to determine if there are any programs which relate to the topic. When the query 
identifies a program related to the topic, the EPG automatically notifies the viewer. 

Fig. 13 shows two queries that execute in background. The first query 284 
identifies and notifies the viewer of all "Seinfeld" programs and the second query 
286 identifies and notifies the viewer of all Clint Eastwood movies. When the 
viewer looks at the upcoming schedule for 2:00 PM, the EPG TJI 288 shows all 
programs from the filtered version of the EPG UI 170 which show at 2:00 PM, 
such as the US Open Golf and Seinfeld. The EPG UI 288 also shows any 
programs identified by the background queries as a result of searching the EPG 
database 72. Here, the background queries 284 and 286 identified a Seinfeld 
program playing at 2:00 PM and a Clint Eastwood movie "Pale Rider" at 6:00 PM. " 
Since there is a conflict at 2:00 PM, the viewer can choose between the Seinfeld 
program and the US Open Golf program. 

Since the movie Pale Rider is notuntil 6:00 PM, the viewer can place a 
notification icon 290 on the screen to remind him/her of the program. The viewer 
clicks on the program, drags it from the EPG UI 288, and drops it at another 
location on the screen. The drag-and-drop operation results in creation -of an 
instruction to tune the visual display unit to the program upon activation of the 
icon. The EPG can flash the icon, or cause some other visual change, when the 
start time of the program nears. 

The EPG can also automatically create these reminders, without 
intervention of the viewer. When the EPG identifies a program, such as Pale Rider 
in response to the background query 286, the EPG can be configured to 
automatically set an icon 290 on the screen for the viewer. The viewer can also set 
an option for the EPG to initiate recording of the program in the event that the 



this manner, if the viewer is unable to watch the program at the schedule time, the 
EPG intelligently queries the database for upcoming programs, identifies any 
programs that meet the viewer's search parameters, notifies the viewer, and 

triggerable events that may be set based on the queries, such as automatically 
downloading information about the identified program, calling particular content 
ftom the Web, or launching a purchasing application to purchase goods related to 
the identified program. 

This example illustrates concurrent use of multiple filters including 
personal background filters and an active general filter. The EPG can be - 
configured to perform any number of queries, such as any restrictive queries for 
the logged on viewers, then any general queries, and then any background queries 
to filter the programs found in the EPG database to a manageable set of preferred 

Another aspect of this invention is to provide queries which filter 
information from the EPG database and from one or more Web sites on the 
Internet. The query results can be presented to the user in a single UL The queries 

readily filter during online communication with the Internet, or queries that filter 
information in a local cache filled with Internet data. 

Fig. 14 is similar to the arrangement of Fig. 13, but shows the effect of 
queries operating on both the EPG database and an Internet Web site. Fig. 14 
shows two queries, an EPG database query 282 which filters data in the EPG 
database 72 to remove all science fiction programs and a Web cache query 292 



which filters a Web cache 294 to locate only news programs. The Web cache 294 
contains recently retrieved from one or more Web sites on the Internet. 

The results of the two queries are displayed together on UI 296 to present a 
list of options to the viewer. The viewer can optionally select programs served by 
the content provider over the primary distribution network, or content served by 
the Internet provider over the Internet By using an integrated UI 296, the viewer 
might be unaware as to the source of trie content. 

Fig. 15 shows a quick find window 300 supported by the EPG application 
1 64 which presents another technique for creating a query. This technique enables 
a viewer to enter data from a numeric keypad on the remote control handset. The 
numeric keypad is a conventional 0-9 digit keypad. Numbered keys 2-9 also have - 
letters associated with them, similar to a conventional telephone, except the 
number "7" key includes the letter Q and the number "9" key includes the letter Z. 
Table 2 shows the association of the numbered keys and letters. 



Table 2: Association of Letters to Numbered Keypad 



W, X, Y, Z 



Suppose a viewer wants to watch a particular program or network, but 
cannot remember what channel it is on. Remember, there are expected to be 
hundreds or thousands of channels, and trying to locate a particular program or 
network by memorizing each channel number may prove futile. To decouple the 
association of channel numbers to networks and programs, the EPG enables the 
viewer to enter data from the 10-key keypad for both channel numbers or letters in 
the program or network name. The EPG performs the mapping to identify any 
program, channel, or network that matches the entered data. 

The quick find window 300 is activated by pressing one of the keys on the 
remote control handset With quick find active, the viewer presses individual keys 
on the remote control handset to enter data, one digit at a time. As each key is 
depressed, however, the EPG does not know if the viewer intends to enter a 
number or a letter. Accordingly, for each key, the EPG constructs a query which 
interprets the data as possibly representing a number or one of the letters 
associated with the numeric key. The EPG then executes the query to identify any 
EPG data item (i.e., channel, program, network, etc.) that satisfies the query. As 
the viewer continues to enter digits, the EPG constructs and executes queries to 
continuously narrow the list until only a few EPG data items satisfy them. 

With reference to the example shown in Fig. 15, suppose the viewer is 
interested in watching the Orlando Magic basketball team. The viewer activates 
the quick find window 300 and begins entering the word "Magic." The viewer 
first depresses the "6"-key, which has the associated letters M, N, and O, to enter 



beginning with the digit "6," "M,", "N," or "0." 
is represented as follows; 



Query 1 = 6* or M* or N* or O* 



The symbol "*" means that any digit or digits < 
r shown. The query returns a long list of items 



Query 1:6* orM*orN*c-TO» 

MTV 

Chicago Bulls at Orlando Magic 
Seattle Mariners v. Boston Red Sox 
Market Wrap 
Magical World of Science 
Magic Kingdom at Disney World 
Orlando Magic v. Chicago Bulls 
Nashville Live 
NBC 

Nick-at-Night 
Outer Limits 

Channel 61 



The viewer next depresses the "2"-key, which has the associated letters A, 
B, and C, to enter the letter "a" in "Magic." The EPG constructs a query for all 
EPG items in the first list having a next digit beginning with "2," "A,", "B," or 
"C." In Boolean logic terms, the query is represented as follows: 

Query 2 = 62* or MA* or MB* or MC* or NA* or NB* or NC* 
or OA* or OB* or OC* 
The query returns a shorter list of items, including the following examples: 

Chicago Bulls at Orlando Magic 
Seattle Mariners v. Boston Red Sox 
Market Wrap 
Magical World of Science 
Magic Kingdom at Disney World 
Orlando Magic v. Chicago Bulls 
Nashville Live 
NBC 

Channel 62 
Channel 621 



The viewer next depresses the "4"-key, which has the associated letters G, 
H, and ], to enter the letter "g" in "Magic." The EPG constructs a query for all 
EPG items in the first list having a nest digit beginning with "4," "G,", "H," or T" 
In Boolean logic terms, the query is represented as follows: 

Query 3 = 624* or MAG* or MAH* or MAP or MBG* or MBH* . . . 
... or OCG* or OCH* or OCI* 

The query returns a much shorter list of items, including the following; 

Chicago Bulls at Orlando Magic 
Magical World of Science 
Magic Kingdom at Disney World 
Orlando Magic v. Chicago Bulls 
Channel 624 

By entry of the third digit— the letter "g"— *e list of possible programs, 
networks and channels has been dramatically reduced to a short list that can be 
presented to the viewer. If the viewer continues to enter the letters "i" and "o" in 
"Magic," the list is pared down to four items shown in the quick find window 300 
in Fig. 1 5. The viewer can then choose a program from the list by clicking on the 

channel carrymg the selected program. 



An alternative technique to searching on each number or letter is to pre-map 
the program and network names into associated identification numbers which can 
be stored as part of the data record in the EPG database. For instance, the network 
name MTV has an associated identification number "688," where Die letter "M" is 
mapped to the number "6," the letter "T" is mapped to the number "8," and tie 
letter "V" is mapped to the number "8." With this pre-mappcd identification 
number, the EPG can simply search on each numerical data and return all channel 
numbers, and all programs with identification numbers satisfying the query. 

The quick find feature is very useful to the viewer. The viewer need not use 
the remote keyboard to enter names of programs or networks (although the 
keyboard may be used). Instead, the viewer enters the data using the 10-key " 
keypad on the remote control handset and the EPG simultaneously considers all 
possible meanings of the data. Although this may seem laborious, entry of just a. 
few digits (e.g., 3 to 6) is often sufficient to reduce the set of possible channel 
numbers, programs, and network names to only a few which can be conveniently 
displayed to the viewer. 

The quick find feature is described above as performing a new set of 
queries after each digit is entered. However, the EPG can be alternatively 
configured to await entry of multiple digits before performing the queries. For 
instance, the EPG can keep track of the sequence of entered digits, and the various 
permutations of possible letter combinations within the sequence, and then 
subsequently perform queries on those possibilities. 

It is noted that the above example describes the viewer as entering data 
using a keypad on the remote control handset In other embodiments, the EPG is 
configured to present a keypad of soft buttons (i.e., buttons shown as part of the 



graphical UI on the monitor) which the viewer can select using a handset or some 
other remote device to enter the data. Additionally, the viewer can enter channel 
numbers, program names, and network names using the remote keyboard. 

It is noted that the term "program" is represented in examples as traditional 
television shows, or movies. The term "program" is not to be limited, however, to 
only these forms of programming. The term "program" is to be given a broad 

network or stored locally. Examples of "programs" include TV-like shows, 
movies, games, interactive supplemental data, financial records or programs, 
educational materials, communications records, software, document files, and the 
like. 

The query-base EPG system described herein is advantageous because it 

viewer can create simple queries to search on prearranged categories or complex 
queries to search across arbitrary fields. The EPG permits viewers to merge their 
individual queries into a composite query, which offers tremendous convenience 
for groups of viewers. The EPG also permits a viewer to save queries in a 

The invention has been described in language more or less specific as to 
structural and methodical features. It is to be understood, however, that the 
invention is not limited to the specific features described, since the means herein 
disclosed comprise preferred forms of putting the invention into effect. The 
invention is, therefore, claimed in any of its forms or modifications within the 



proper scope of the appended claims appropriately interpreted in accordance with 
the doctrine of equivalents. 



4. Brief Description of Drawings 

Fig. 1 is an exemplary screen illustration of a graphical user interface (UIJ 
window presented by a prior art product which organizes programs into predefined 
categories. 

Fig. 2 is an exemplary screen illustration of a graphical user interface (UI) 
window presented by the prior art product which assists a viewer in searching the 
predefined categories to locate certain kinds of programs. 

Fig. 3 is a diagrammatic illustration of an entertainment system. 



Fig. 4 is a simplified example of data fields in a data structure maintained 
by an electronic program guide (EPG). 

Fig. 5 is a block diagram of a viewer computing unit. 

Fig. 6 is an exemplary screen illustration of an EPG TJI, and particularly, a 
screen having a scrollable grid with program listings. 

Fig. 7 is an exemplary screen illustration of an EPG TJI, and particularly, a 
screen lised to help create simple queries for searching the EPG. 

Fig. 8 is an exemplary screen illustration of an EPG UI, and particularly, a 
screen used to help create more advanced queries for searching the EPG. 

Fig. 9 is a diagrammatic illustration of how a query filters the program 
database of the EPG to identify programs satisfying the parameters of the query. - 

Fig. 10 is a diagrammatic illustration of how a restrictive query filters the 
program database of the EPG to identify and prevent programs satisfying the 
parameters of the query from being displayed. 

Fig. 11 is an exemplary screen illustration of an EPG TJI, and particularly, a 
screen used to manage queries for multiple viewers. 

Fig. 12 is a diagrammatic illustration of how individual queries can be 
merged into a composite query used to search the program database of the EPG. 

Fig. 13 is a diagrammatic illustration of how program information is filtered 
through multiple queries to provide a short set of programs that are ultimately 
displayed to the viewer. 

Fig. 14 is a diagrammatic illustration of how program information in an 
EPG database and other content information in a Web cache are filtered using 
multiple queries to provide a short set of programs that are ultimately displayed to 
the viewer. 

SI 



Fig. 15 is an exemplary screen iUustration of an EPG UI, and particularly, a 
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An electronic program guide (EPG) organizes and presents programming 
information to the viewer and allows for creation of queries to facilitate both 
simple and complex searches of the programming information. According to one 
aspect, the EPG is configured to automatically identify programs that a viewer is 
likely to prefer. The EPG collects viewing preferences of a viewer and, based 
upon the these viewing preferences, automatically develops queries for identifying 
programs that the viewer is likely to want to watch. The EPG further enables 
multiple viewers to merge their individual queries into one composite query or to 
run queries in background to periodically check for programs and notify the viewer 
when a program is identified. Queries are saved in an EPG database in a 

for a channel, network name or program name using a 1 0-key keypad. The viewer 

viewer might intend to enter a number or letter. The EPG is configured to interpret 
the data as representing all possible choices, including the number and -letters 
associated with the key. For instance, when a viewer depresses the key with 
number "5," the EPG interprets that data to mean "5" or T or "k" or "1." The 
EPG identifies all programs, channels, and networics which begin wim the number 
or letters. As the viewer continues to enter data, the list of programs, channel, and 
networks dynamically narrows so that after a few button presses, the viewer is 
presented with a short list of possible choices. 
2 Representative Drawing 



